SIGNED ENUMERATION OF RIBBON TABLEAUX 



DOMINIQUE GOUYOU-BEAUCHAMPS AND PHILIPPE NADEAU 

Abstract. We give an extension of the classical Schensted correspondence 
to the case of ribbon tableaux, where ribbons are allowed to be of different 
sizes. This is done by extending Fomin's growth diagram approach of the 
classical correspondence between permutations and pairs of standard tableaux 
of the same shape, in particular by allowing signs in the enumeration. As an 
application we give a combinatorial proof for the column sums of the character 
table of the symmetric group. 



1. Introduction 

The Schensted correspondence [22 is a bijection between permutations and pairs 
of standard Young tableaux of the same shape. It has been extended in numerous 
ways, the most famous being certainly the Robinson-Schensted-Knuth correspon- 
dence between matrices of integers and pairs of semi-standard tableaux of the same 
shape. Other extensions exist, for instance oscillating tableaux [29l [2j [3] [4] , skew 
tableaux [20 , shifted Young tableaux [21] , and fc-ribbon tableaux [23j [28] . 

Sergey Fomin developed a general theory of such correspondences, cf. [5] [7] 
[HI [S] • It unifies the correspondences listed above by interpreting these tableaux as 
paths in so-called graded graphs. For instance, a Young tableau in this context is 
viewed as a particular kind of path in the graph whose vertices are integer parti- 
tions, and where (A, fx) is an edge if \i is a partition obtained after adding 1 to a 
part of A. This graph is usually called the Young graph (or Young lattice). Other 
combinatorial objects can be then represented by considering other paths, for in- 
stance by modifying the extreme points of the path, or the edges that one can use. 
This is a way of looking at oscillating or skew tableaux inside the Young graph for 
instance. Then the local properties of the graph will give rise to various bijective 
correspondences, all consequences of one elementary bijection. 

Furthermore, Fomin gives in parallel a linear algebraic approach to his results, 
which is directly inspired by the work of Stanley [35]. As a matter of fact, most of 
Fomin's results have both a bijective and an algebraic proof. 

In [51] . Dennis White describes another extension of the Schensted correspon- 
dence for ribbon tableaux where ribbons are allowed to have different sizes; his goal 
was in fact to give a combinatorial proof of the second orthogonality relation for 
characters of the symmetric group. The algorithm describing his correspondence is 
a complicated insertion mechanism, along the lines of the original Schensted corre- 
spondence; this forces him moreover to put some restrictions on the ribbon tableaux 
he considers. 
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We will show here how the approaches of Fomin -both bijective and algebraic- 
can be adapted to apply to the correspondence of White. There will be two benefits: 
first, this will extend the original work of White, by getting rid of his restrictions in 
particular. Second, in the process we will have to extend Fomin's setting to graphs 
which are more general than the ones considered in [6] [7] . 

Note that we will deal here with signed enumerations, meaning that we will 
count objects with weights plus or minus one. It will appear that, for the bijective 
approach, we will have to appeal to the famous involution principle of Garsia and 
Milne [T2]. 

The paper is organized as follows: in Section [2] we give the main definitions 
about ribbons and ribbon tableaux, as well as some elementary operations on these 
objects. In Section [3] we define different notions about signed enumeration, and wc 
recall the famous Involution Principle of Garsia and Milne. Section [4] introduces 
hook permutations and involutions, which are the objects in correspondence with 
ribbon tableaux in our main results. Section [5] states these results, which are 
Theorems [10] and 1121 there exists a signed bijection between hook permutations 
and pairs of ribbon tableaux of the same shape. The description of the bijections 
is given in the two following sections: in Section [6] we recall some local rules that 
depend on the operations introduced in Section [2] and Section [7] shows how to 
define a global correspondence from these local rules. The technical parts of the 
proofs are given in Appendix [B] In Section [8] an algebraic version of Theorem [10] 
is given. 

Section [9] contains an application of Theorem [12] to the column sums of the char- 
acter tabic of the symmetric group. Finally, Section [TOl explains how the methods 
developed can be used for other enumerations, and details in what ways this bi- 
jective and algebraic setting is a generalization of Sergey's Fomin graded graphs in 
duality. 

2. Ribbons 

2.1. Definitions. A partition A = (Ai, . . . , A m ) is a nonincreasing finite sequence 
of positive integers; these integers are the parts of the partition, the size of the 
partitions being their sum |A| := Y]- \j. A composition c is as finite sequence of 
positive integers; we can associate to c a partition c by rearranging the integers in 
nonincreasing order. A partition A of size n can be described with the exponential 
notation A = [P 1 , 2 n ■ ■ ■ n ln ], where ji is the number of parts of size i. If ji = 0, 
then i 3i is not written and if ji = 1, ji is not written. 

We will identify a partition (Ai, . . . , A m ) with its Ferrers diagram, which is the 
left justified set of cells (i.e. unit squares of Z 2 ) such that the ?th row from the 
top contains Ai cells; the diagram on the left of Figure 1 represents the partition 
(8,6,5,2,2,1,1) = [1 2 2 2 568]. 

Let Y be the set of integer partitions, and Y„ the subset of partitions of size 
n. Two partitions A C /i (in the sense of inclusion of Ferrers diagrams) define 
a skew shape We will identify here a skew shape with the set of cells /i\A, 

whenever /x or A is clear from the context; though, in general, two distinct skew 
shapes may define the same set, this will not create any ambiguity here. The size 
of is its number of cells |^| — |A| and will be noted |/i/A|. The skew shape 
(9,8,7,4,4, 1, l)/(8,6,5,2,2, 1, 1) represented on the right of Figure Q] has size 9. 
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Figure 1: Partition and skew shape. 
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Figure 2: Examples of ribbons. 



Let us say that a subset S of cells of Z 2 is connected if, for every two cells c, d in 
S, there exists a sequence of cells c = cq, cj., . . . , Cj = d in 5 such that Cj, Cj+i have 
a common side for all i. We can then define the notion of ribbons: 

Definition 1. A ribbon is a connected skew shape that does not contain a 2 by 2 
square of cells. 

Let r = /z/A be a non empty ribbon. Such a ribbon is said to be /x-addable and 
A-removable. Its height h(r) is defined as the number of lines it occupies minus one, 
and its sign is then e(r) := (—l) ht - r K By convention we will set e(A/A) := 1. The 
bottom left cell of r is its tail, and the top right one is its head. Given a partition 
A, the ribbons that can be removed or added to A are entirely determined by the 
coordinates of their heads and tails. On Figure are two ribbons: the left one has 
size 4, height 2 and sign +1, and the right one has size 6, height 1 and thus sign 
-1. 

A hook is a non empty ribbon of shape A/0, which is equivalently a partition of 
the kind (k, 1, ... , 1). Note that a hook is characterized by the data of its size s 
and height he [0, s - 1]. 

For i a positive integer, we note Ribi the set of ribbons of size i, and Rib := 
{J i>0 Ribi- One should think of Y as the vertices of a graph GR whose edges 
are the elements of Rib; each edge carries in addition a sign which is simply the 
sign of the corresponding ribbon. GR is structured in different levels given by the 
partitions of a given size. Figure [3] shows the first levels of GR, where the dotted 
edges correspond to negative ribbons. Adding (respectively removing) a ribbon 
corresponds simply to making a step up (resp. down) in GR. 
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Figure 3: First levels of the ribbon graph GR. 



Definition 2. A ribbon tableau of shape A G Y and length £ is a sequence of 
partitions A° = C A 1 C . . . C X e = A such that Ti :— A i+1 /A l is a nonempty 
ribbon for every i < I. 

We will often represent a ribbon tableau by a labeling of the cells of A, in which 
the cells labeled i coincide with the ribbon . Note that a ribbon tableau is equiva- 
lently a path of length £ in the graph GR, going up from to A; this interpretation 
is the key to the extensions described in Section [TU1 

We need some more definitions. The sign e(P) of a tableau P is the product of 
the signs of the ribbons r^. The content c(P) is the composition of |A| in £ parts 
formed by the sequence of sizes \r^\. We will note RT\ iC the tableaux of shape A 
and content c, where c is a given composition of |A| and RT\.i the set of all the 
ribbon tableaux of shape A and length I. 

Figure 0] shows a tableau of shape (8,6,6,2,1), content (1,6,6,3,7) and sign 
(_l)0(_i)a ( _i)3(_i)i(_i)3 = _ L 

2.2. Operations on ribbons. We will now introduce some classical operations on 
ribbons which are necessary for the definition of the local rules of Section [SI 

bumpin, bumpout: let A be a partition, and r, r' be two ribbons that are A- 
addable, such that r and r' have different heads and different tails. Then bumpoutir, r') 
is the set of cells (r\r') U (r'\r) U (r' n r)\ where is the translated of A by the 
vector (1, —1). The operation bumpin(r, r') is similarly defined for two ^-removable 
ribbons, by translating the common cells between r and r' by the vector (—1, 1) 
(these definitions vary slightly from the ones commonly used) . Figure [5] shows the 
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Figure 4: A ribbon tableau: two equivalent representations. 



way this operation acts, according to the relative positions of r and r': they can be 
disjoint, or partially overlap, or one can be included in the other. 




bumpout 




Figure 5: Operations bumpin and bumpout 



prev, next, first : Let A be a partition, k a positive integer, and h a nonnegative 
integer. A result of Shimozono and White [53] is that if (rj), = o...t (respectively 
(r'i)i=i...t') are all ribbons of size k and height h that are A-addable (resp. A- 
removable), then (1) t=t', and (2) the enumeration order of the ribbons can be 
chosen so that ro < r' x < r\ < . . . < r' t < r t where rib\ < ribi means that the head 
of ribi is north east of the head of r«6 2 - 
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Figure 6: Addable and removable ribbons of height 1 and size 3. 



Figure [6] illustrates Shimozono and White's result. This allows to define certain 
operations first, next and prev on ribbons: 

• if hk is a hook of size k and height h, we define first(X, hk) as the ribbon 
ro above. 

• If r' is a A-removable ribbon, i.e. r' = r\ for a certain i £ [l,t], then 
next(X, r') := rv 

• Reciprocally, if r = for any i £ [1, t\ is a A-addable ribbon, we define 
prev(X, Ti) := r[ for i > 1, and prev(X, ro) := 0. 

slideout, switchout, slidein, switchin: let A be a partition, and r, r' two A- 

addable ribbons , with identical tails but different heads; we assume without loss 
of generality that \r\ > \r'\. The external band of A consists of all cells between 
the infinite south east boundary of A and its translated by (1, —1), i.e. the cells 
enclosed by the dotted line on Figure [7] Let r be the subset of the external band 
formed by the \r'\ connected cells, north west of r and adjacent to it. Then two 
cases can occur: 

• if rUr forms a A-addable ribbon, we define the partition slideout(X, r, r') = 
AUrUr. 

• otherwise, we define switchout(X,r,r') = (A U r')\r\, where is the 
translated of r by the vector (—1,1). 

If r and r' have the same head but different tails, one performs the same opera- 
tions on the transposed partitions. The operations switchin and slidein are defined 
similarly on A-removable ribbons: see White |31j for supplementary explanations. 

3. Signed sets and signed bijections 

In this work we have to deal with signed enumerations, so we need some defi- 
nitions and notations to explain what we mean by a bijection in this context. All 
sets are assumed to be finite. 
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Figure 7: Operations switchout and slideout. 



Definition 3 (Signed Sets). A signed set is a set A together with a decomposition 
A = A + U A~ where A + n A~ = 0. The members of A + are positive elements, 
those of A~ are negative. 

Such a decomposition is equivalent to a function 5 : A — > {1,-1}, with the 
obvious correspondence A + = and A~ = 1}). Our objects of 

study here are the sets RT\^ , the sign being given by the function e. Note also 
that unless explicitly stated, usual sets are considered as positive sets. 

A function / between two signed sets is sign preserving (resp. sign reversing) if 
a and f(a) have the same sign (resp. different signs) for all a. Fixed points of a 
function i form the set Fix(i). 

Definition 4 (Signed bijections). A signed bisection between the signed sets A and 
B is the data of 3 functions i A ,iB and <ft such that i A (resp. is) is an involution 
on A (resp. B) which is sign reversing outside of its fixed point set, and </> is a sign 
preserving bijection between Fix(i A ) and Fix{is)- 

The signed cardinal (or signed sum) of a signed set A is \A\± — \A + \ — \A~\; if the 
sign is given by a function S, then we have \A\± — J2 a eA $( a )- A signed bijection 
between A and B proves that \A\± = \B\±; indeed we have 

\A\± = \Fix{i A )\± = \Fix(i B )\± = \B\±. 

The central equality comes from the sign preserving bijection (p, the other ones 
from the fact that i A and is are sign reversing, so the pairs {a,iA(a)} such that 
a 7^ i A {o) have a zero contribution to the signed cardinal of A, the same being true 
for B and i B . Now \A\ ± = \B\± is equivalent to \A+\ + \B~\ = \B+\ + \A~\, and a 
bijection proving this equality (i.e. a bijection ip between the usual sets A + U B~ 
and B + U A~) is clearly equivalent to a signed bijection between A and B. This 
explains why signed bijections are the correct generalizations of bijections, in that 
they give a combinatorial explanation of the equality of signed cardinals. 
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The Involution Principle of Garsia and Milne 

Garsia and Milne gave the first fully bijective proof of a combinatorial version 
of a famous identity of Rogers-Ramanujan [HI [12]: this states that the number of 
partitions (Ai, . . . , Afc) of n verifying A-j — Ai+i > 2 for alH < k is the same as those 
verifying A^ = 1 or 4 modulo 5 for all i < k. To achieve this, they defined and used 
a general principle, that we recall now. 

Let A, B be two finite signed sets. Let also %a^b be two involutions on A and 
B respectively, and 4> a bijection between A and B. We suppose that <fi preserves 
signs, whereas %a and %b reverse signs outside their fixed point sets. 

Under those assumptions one has clearly |-Fia:(ij4)|± = \Fix(is)\±, but not nec- 
essarily a signed bijection proving this equality. The principle of Garsia and Milne is 
the construction of such a signed bijection {ip , j a, j b) between Fix(iA) and Fixiis) 
in the following manner: let a S A. We apply to it the function tj> : A — > B, then 
alternatively, the functions oi B ; B A and 4>oi A ; A — > B, stopping as soon 
as the element x obtained is: 

• either in Fix{iA), in which case one sets Ja{o) '■= x; 

• or in Fix(iB), in which case one sets ip{. a ) '■= x (and Ja{o) '■= a)- 

To define jb (and one uses the symmetric procedure starting from b G 

B. These procedures terminate and give the seeked signed bijection: see for in- 
stance [TH p. 76] for a proof. 



We now introduce the notions of hook permutations and hook involutions, which 
play the role of the ordinary permutations and involutions of the Schensted corre- 
spondence in our main results stated in Section [5l 

4.1. Hook Permutations. If H = {Hi, . . . , Hi) is an ordered sequence of I hooks, 
its content c(H) is the composition (|-Hi|, . . . , |-Hi|)- 

Definition 5. A hook permutation (H, a) is an ordered sequence H = (H±, . . . , H() 
of I hooks, together with a permutation a of [ij . The length of a hook permutation is 
£, its size is J2i and its content c(H, a) is the composition QU^rnl, . . . , \H a ^ |). 

We will write TCP for the set of hook permutations, its elements of content \x 
forming TCP{^l) (where [i is any composition). Hook permutations can be repre- 
sented by the list H where the cells of hook Hi are numbered by o~(i), or by square 
arrays of size £ such that entry is empty unless j — o~{i) in which case it is 
occupied by the ith hook Hi. Illustrations are given Figure [5] 

We then have the following proposition: 

Proposition 6. The number of hook sequences of length £ and total size n is equal 



Proof: Given such a hook sequence, we can associate to it 2£ — 1 integers in 
[n+£— 1], as illustrated graphically on Figure^ in which n = 23, £ = 5, so n+£—l = 
27 and 2£-l = 9, and the subset of integers is {4, 7, 9, 12, 13, 19, 21, 22, 26}. 

Conversely, if we have 2£ — 1 integers 1 < i% < . . . < i2t-i < n + £ — 1, and we 
set by convention ig = and in — n + £, then the list of hooks (i?i, . . . , Ht) in 
bijection is characterized by the fact that Hi is the hook of size in — in-i ~ 1 and 
height in~\ — in-i — L This is clearly bijective. □ 



4. Hook permutations and hook involutions 
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Figure 8: Two representations of the same hook permutation of length 5, size 23 
and content (6, 4, 6, 2, 5). 
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Figure 9: The bijection in Proposition [6] 



4.2. Hook Involutions. 

Definition 7. Hook involutions are hook permutations such that their array repre- 
sentation is symmetric with respect to the diagonal i = j . 

In other words, these are hook permutations (H, a) such that a is an involution, 
and Hi = Hj if j = o~(i). For a hook involution / = (H,o~), we define its sign as 
£ (-0 = Y\i/oU)=i £ (Hi)- ^ is the product of the signs of the hooks associated to 
fixed points. 

We note TCI the signed set of hook involutions, TtT(n) the signed subset of those 
hook involutions with content /x, and finally Ti.2 spec (fi) the elements of 7i.I(/j,) all 
of whose fixed points are hooks of odd size and of height 0. Note that all elements 
of TCI S pec(fi>) are then positive. 

Lemma 8. There is a sign reversing involution on TCI{^jL)\TCI spec {iJ,) . 

Proof: If I = (H,a) ^ HI S pec(n) then let i = a(i) be its smallest fixed point 
contradicting the definition of HX sp ec(^)- Let h be the height of the hook Hi. If 
Hi is of even size , then we let H[ be the hook of the same size and of height h + 1 
(resp. h — 1) if h is even (resp. odd). If Hi is of odd size, so that necessarily h ^ 
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by the definition of Hi , then we let H- be the hook of the same size and of height 
h + 1 (resp. h — 1) if h is odd (resp.even). 

Let H' be the hook list equal to H except in position i where H[ replaces Hi. 
If we define f(I) = (H',cr), then we have the desired sign reversing involution on 

m(n)\m apec (fi). □ 

Corollary 9. For any composition /j,, \H.T((i)\± = \T-CI spec (jj,)\. 
We will give some consequences of this result in Section El 



5. Main results 

The first result is a generalization of the Schensted correspondence. We note by 
Id the identity function on hook permutations. 

Theorem 10. Let n,£ be two positive integers. There exists an explicit signed 
bijection (Id,i,<p) between hook permutations of size n and length i, and pairs of 
ribbon tableaux of size n and length t with the same shape. 

This bijection preserves contents, which means: if i(P,Q) — {P\,Q\) ; then 
c(P) = c(Pi) and c(Q) = c(Qi); and if <p(a,H) = (P,Q), then c(H) = c(Q) 
and c(H,a) = c(P). 

We will define the signed bijection is given in Section [3 based on local rules 
given in Section [6j the proof of the correctness of the bijection is in Appendix [Bl 
In the special case where contents are partitions with certain constraints, then the 
preceding theorem is equivalent to the main result of White in [31] . The idea here is 
to use Fomin's techniques 0(7] in the proof of this result: this sheds a new light on 
White's result, and lends itself to generalization in a more straightforward fashion. 

The theorem has the following consequences concerning the signed enumeration 
of ribbon tableaux: 

Corollary 11. Let /x, v be two compositions of n with £ parts, and write Jl = 
[V 1 ,2^- ■■■]. Then 

£ £ (P) £ (Q) = %-l^(ii!)2^(i 2 !)...; (1) 
agy„ 

PeRT x ^.QeBT XilJ 

E < p )^) = { n tt-i)- 1 - (2) 

P,Q£RT x ,t 

We will show that this corollary can be proved by techniques of linear algebra in 
Section [H Finally, the Schensted correspondence has the property that it restricts 
to a bijection between involutions of & n and standard tableaux of size n. We will 
prove a version of this result for ribbon tableaux: 

Theorem 12. Let n,£ be two positive integers. There exists an explicit signed 
bijection between hook involutions of size n and length £, and ribbon tableaux of size 
n and length £. 

As explained in Section [71 this cannot be deduced from White's correspondence 
for pairs of tableaux. We will prove this Theorem in Section [Jj and Appendix El 
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6. Local Rules 

We wish to extend local the rules used by Shimozono and White [23] to deal 
with ribbons of all possible sizes; this will be done simply by reformulating White's 
insertion rules of [31j as local rules. In all this section fi, v are two partitions of 
respective sizes m and n. 

For i a nonnegative integer, we define Ui((i,v) as the set of partitions of size 
max(ra, n) + i such that and £/v are ribbons. Ui(fi,v) is a signed set through 
s S n (£) := £ (^,/t l ) ' Similarly, we define T>i(fi, v) the set of partitions of size 

min(m, n) — i such that A/ fi and X/v are ribbons; T>i(\i, v) is a signed set through 
sgn(X) := e(/i/A) -e(v/X). ( Note that, as signed sets, Ui{fi,fi) and T>i(/i, /i) contain 
only positive elements.) 

We draw a square where 2 corners are labeled by fi 
and v as shown on the right. The bottom left corner will 
be labeled by partitions A from a set T>i(fi,u), the top 
right one by partitions £ from a set Ui(\x,v). In the case 
A = fi = v, the interior C may be marked by a nonempty 
hook, or be left empty; in all other cases it is left empty. 

To define local rules, it is necessary to use the operations on ribbons and parti- 
tions defined in Section [21 

Let ((A, C), fi, v) be given in a square, as above. What we mean by applying a 
local rule is the following: first find out which case applies in the list below, then 
erase A and C from the square, and finally write the outcome of the rule in the 
appropriate corner: the top right one for the rules Dl to D6, and the bottom left 
one for the rule S. 

Direct rules: in the following rules A is an element of a certain Di(fi, v), C 
is empty unless possibly when A = /i = v in which case it may be filled by a hook. 
Let r, r' be the ribbons fi/X and u/X (allowing empty ribbons). 

• If A = fi = v and C is empty, then £ := A. (Dl) 

• If A = fi = v and C is a nonempty hook eg, then £ := A U first(X, eq). (D2) 

• If A 7^ \i = v, then £ := ji U next{n, (J-/X). (D3) 

• If A = fi =/= v (resp. X~v^fi), then £ := v (resp. £ :=/*)• (D4) 

• If A ^ fj, ^ v, then: 

— if r and r' have neither the same tail nor the same head, then £ := 
X\Jbumpout(r,r'). (D5) 

— if r and r' have the same head but different tails, or the same tail but 
different heads, then: 

* if slideout(X, r, r') is well defined, then £ := slideout{X, r, r'). (D6) 

* otherwise, we set A := switchout{X,r,r r ) € Di([i,v). (S) 

Inverse rules: Now £ belongs to a certain set Ui(fi, v). We write r, r' for the 
ribbons and £/v (possibly empty). C is left empty except in rule (12). 

• If £ = fj, = v , then A := £. (II) 

• If £ 7^ fi = v, then 

— If prev{^, r) = 0, we define X := /i and C is filled with the unique hook 
of size |r| and height h(r); (12) 

— otherwise A := /i\prev(^,r). (13) 

• If £ = fi 7^ v (resp. £ = v ^ n), then A := v (resp. X := fi). (14) 
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• If £ ^ (i is, then: 

— if r and r' have neither the same tail nor the same head, then A := 
£\bumpin(r,r'). (15) 

— if r and r 1 have the same head but different tails, or the same tail but 
different heads, then: 

* if slidein(£,r,r') is defined, then A := slidein(£,r,r'); (16) 

* otherwise we set £ := switching, r, r') G Ui(ii,v). (T) 

Proposition 13. The rules Dl to D6 are the respective inverses of II to 16; S and T 
are involutions. Furthermore, D1-D6 and 11-16 preserve signs between T>i(n, v) and 
Ui{\i,v), whereas S and T are sign reversing on z/) and Ui(fJ,, v) respectively. 

Proof: All these properties are already proved elsewhere, albeit sometimes in a 
different form. For D2,D3 and 12,13 this was proved by Shimozono and White [23] . 
For the rules D5,D6,I5,I6, S and T, the result can be found in White [51] . We will 
anyway give the proof for the rule S in Appendix^ using the encoding of partitions 
by infinite sequences S(X): we wish to show how this encoding is particularly suited 
to the study of ribbons. □ 

Let us sum up the local rules in terms of signed bijections, since this will be 
useful in particular in the algebraic approach of Section [8] 

Proposition 14. Let ji, v be two partitions and i a positive integer. 

(a) There exists an explicit bijection <f>\ between Ui(fi, /i) and ~Di (//, /i)U[0, i— 1]. 

(b) For /i ^ v, there exists a signed bijection (io, iu, 4>2) between T>i{^,,v) and 

Ui{pL, v). 

Proof: (a) is given by rules D2 and D3; for (b), the involutions ir> and ijj are 
given by rules S and T respectively, and the bijection <fa consists of rules D4,D5 
and D6. □ 

This proposition has to be interpreted as a local property of the graph GR: given 
fi and v of size m and n, it gives a combinatorial link between vertices adjacent to 
both /x and v at the level min(m, n) — i, and at the level max(m, n) — i. Sections [7] 
and [8] will use this local structure to deduce global results on ribbon tableaux. 

7. BlJECTIVE APPROACH 

We want to use growth diagram techniques (see [7]) to carry out a signed cor- 
respondence proving Theorems [10] and 1121 This will be done in this section, but 
requires more work than a simple application of Fomin's setting. In order to prove 
Theorem llOl we will actually need to make some back and forth moves in a growth 
diagram; the correction of the correspondence will rely on the Involution Principle. 

7.1. Bijection for hook permutations. Fix a positive integer £, and let Gi be 

the grid of size I X £, made of £ 2 squares (and (I + l) 2 vertices). Square (i,j) is at 
the intersection of the ith column from the left and the jth row from the bottom of 
the grid. We wish now to label some of the vertices by partitions and then apply 
the local rules of Section [6] in the squares: for this, we order the squares (partially) 
by (i,j) ^ if an d only if i < i' and j < j'. 

We fix from now on a total order O extending this partial order. Every square 
sq 7^ (1 , 1) has then a predecessor pred(sq), and every square sq ^ (£, £) has a 
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successor succ(sq). For dir = ±1, we define also next(sq,dir) to be succ(sq) if 
dir = f , pred(sq) if dir = —1), and to return "undefined" when pred or succ is not 
defined. 

Given dir G {+1, — 1} and a square sg of G^: 

• if dir = 1, and /x, i', A, C label as in the definition of direct rules, we 
apply the corresponding rule; 

• if dir = — 1, and fi,f,^ label sq as in the definition of inverse rules, we 
apply the corresponding rule. 

Let us call this procedure Apply JocaLrule, and write loc:=Apply_local_rule(dir,sg) 
for the local rule that applies. 

Now we want to go from local rules to a correspondence on the entire grid. Let 
us be given a hook permutation drawn Ge, in which we also label by (the empty 
partition) all vertices of Gi on the bottom and left sides (see Configuration A on 
Figure [10]). We may now describe the bijection <j> of Theorem [TUJ which we do in 
an algorithmic fashion: 

Algorithm cf> : 

Input: a hook permutation (H,a). 

Output: A pair (P, Q) of ribbon tableaux of the same shape. 
Begin 

sq := (1, 1); dir := 1; 
repeat 

loc:— Apply _local_rule(dir,sg); 

If (loc £{S,T}) then dir := -dir; end if; 

sg:=next(sg,dir); 

until (sq= "undefined" ) ; 

End 

We will show that this algorithm is well defined and does not loop indefinitely: 
it ends when succ(£, t) is not defined, in which case the vertices on the top and 
right side of Gi are labeled by partitions forming two ribbon tableaux of the same 
shape. 

Example: we illustrate the algorithm on the example of Figure [TCH We choose the 
total order (i,j) < (i',f) if j < j', or j = j' and i < i' . A square c' is thus larger 
than a square c if it is above in the same column, or if d is in a column to the right 
of c. 

We start with the hook permutation given on G3 (configuration A). We apply 
direct local rules to reach configuration B, the rules being successively D2, D4, 
D4, D4, Dl, D2, D4 and D2. Now the rule S applies, and the direction changes 
(configuration C). Note that we deleted all contents of visited squares as well as the 
label of their bottom left corner; we did not show this for direct rules in order to 
keep the number of pictures reasonable. From this configuration C, we apply inverse 
rules 15,12 and 15 successively to reach configuration D. There rule T applies, and 
the direction changes. We finally reach configuration F with the rules D3,D2,D3 
and D6. We can finally read off the ribbon tableaux P and Q respectively on the 
right and top sides of the grid. 

We will prove the correction of the bijection in Appendix [Bl we can already give 
the proof of its corollary: 
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Proof of Corollary 1111 For the first formula, the signed bijection of Theorem 
1101 implies that the left hand side is equal to the number of hook permutations of 
type (c, c'); this number is zero unless c can be obtained from d by permuting some 
of its parts. When c = d ', we have to compute, for a part i appearing jj times, how 
many hook permutations of length ji exist so that all hooks have size i; this number 
is clearly i Ji ji\. We obtain finally the right hand side by multiplying such terms 
for all sizes i. The second equality of Corollary [Tl] is an immediate consequence of 
Theorem [TU] and of Proposition [5] 

7.2. Bijection for hook involutions. The Schensted correspondence is known to 
restrict to a bijection between involutions and standard tableaux, and we wish to 
extend this to hook involutions and ribbon tableaux. But whereas this restriction 
is immediate with Fomin's version of the Schensted correspondence, some extra 
work has to be done here: first, the bijection defined by the algorithmic procedure 
depends on the fixed total order specified on the squares of the grid, so the procedure 
can not be done symmetrically in general. Then, notice that hook involutions have 
signs, whereas hook permutations are defined as positive: we must prove that these 
signs are preserved by the bijections. We will deal with these two extra difficulties 
and give the proof of Theorem [12] in Appendix [B] 

To end this section, we formulate in terms of signed sets the properties which 
are crucial in the proof of Theorem [T2l Define Ui(n) as the set Ui(fi,[i) but with 
sign e(A//i) for A € Wj(/z); similarly, T>i(/j,) is T>i([i, fj) with sign e(/x/A). 

Proposition 15 (Shimozono and White [23 ). Consider [0,i — 1] as a signed set 
with sgn(h) = (— 1) . Then there is a sign preserving bijection between Ui{n) and 

x>,00u[o,i-i]. 

7.3. Relation with previous works. As already mentioned, Theorem [10] was 
partly demonstrated by White [31] (in this article, White evokes the possibility of 
extending his ideas to obtain the form in which we gave it). In [28], the authors 
notice that if one only considers hook permutations with all hooks of size k, and 
ribbon tableaux with all ribbons of size k, then rules S and T can never be applied: 
so in this case we have a (sign-preserving) bijection between ribbon tableaux and 
fc-colored permutations. 

As a matter of fact, rules D2 and D3 are not used in these two articles, but 
alternative rules that do not preserve signs in the sense of Proposition [T5l Theo- 
rem 02] cannot thus be a consequence of White's original work, but is based on the 
work of Shimozono and White [23] (for ribbons and hooks of fixed size), in which 
the authors introduce the operations prev, next, first that are used to define rules 
D2,D3 and 12,13. 

8. Algebraic approach 

The previous section generalized the bijection of Robinson-Schensted; we will 
give an algebraic proof of the enumerative counterpart of these results, that is 
Corollary [Til hi the spirit of Stanley [25] and Fomin [6]. 

Let K be a field of characteristic zero. We consider KY = ©„KY„, the vector 
space of all linear combinations of partitions with coefficients in K. For i a positive 
integer we define two linear operators Ui and Di via their action on the basis of 
partitions: 
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Definition 16. For A 6 Y, 



UiX 



e(r)/i. 



r=fj,/\eR.ibi 



r—X/ [i^Ribi 



Ui and Di are endomorphisms of KY, that send KY„ in KY n+ i and IY n _i 
respectively. We note that these two operators were already defined by Stanley [55] 
but in a different perspective. 

For A,/i two partitions, we set (X,fj) = 1 if A = n and otherwise. We may 
then extend (., .) to KY x KY by bilinearity, and we notice that Ui and Dj are 
dual endomorphisms for this bilinear form; indeed (UiX, /f) = {X,Di/j,} since each 
member in the equality is equal to e(r) if A C \i and r = /z/A is a ribbon, and to 
otherwise. 

The fundamental relation between these endomorphisms is the following (we 
note AB = A o B for composition): 

Proposition 17. For nonnegative integers we have 



Proof: The first equality can be rewritten 

(DiUm,v) = (UiDi+i -Id /i,v) 

i.e. {DiUifi, v) = (UiDifj,, v) + i ■ 5^ v 

i.e. (Uip, Uiv) = (DiiM, Div) + i ■ S^v 

for /i and v any two partitions, while the second equality is equivalent to 

(DiUjpL, v) = {UjDiH, v). 

Those two equalities can be rephrased as \Ui(fJ-, fi)\ = \T>i(jj,, n) \ +i for all /i, and 
\Ui(fJ,, v)\± — \Di(n, v)\± for \x ^ v. But this is exactly the enumerative signification 
of Proposition [Ml which ends the proof. □ 

The first of these two relations is characteristic of i- differential posets, defined 
by Stanley [551 US] > an d which are the basis of [B] (let us remark that our operators 
involve signs, which is not the case in the classical case.). 

Let us now specialize K = Q((<?)), the field of formal Laurent series in q (We 
could in fact limit ourselves to formal power series and in general work with 

commutative rings of characteristic zero). 

Let us define K Y = KY ra the vector space of functions from Y to K, which 
we will write as infinite linear combinations of partitions, with coefficients in K. ft 
is then possible to extend (., .) to KY x K Y without difficulty, and one checks that 
Di and Ui extend also to endomorphisms of K Y . Let us now define operators U 
and D: 

Definition 18. 



DiUi =U l D l + i ■ Id 
»,l , 1,1), ,f i ., j 



(3) 
(4) 




U and D are themselves endomorphism of K Y . U(A) (respectively D(A)) is by 
definition the sum of all partitions fi such that fi/X (resp. A//x) is a ribbon, with 
a coefficient eq k for a ribbon of size k and sign e (note that U does not have its 
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image in IKY) . This interpretation gives us immediately the following formula that 
explains our interest in U and D: 

<P)<Q) = [g 2n ](0,D / U £ 0> (5) 

P,Q£RT x ,i 

So we want to calculate the right hand side of this equality; note first that 
Proposition [IT] can be summarized in a single relation involving U and D: 

DU = UD + (1^2)2 M (6) 

Proof: One just has to take the definition of U and D, develop, and then use 
the relations of Proposition [T7J The coefficient of Id appearing is then seen to be 
Si>i *9 2l j which is equal to the given rational fraction. □ 

In order to compute the coefficient in q in Equation ([5]), we need the following 
result of Stanley : 

Theorem 19 (Stanley [25 ). Suppose that two endomorphisms of a vector space E 
verify DU = UD + rl. Then for all positive integers £ we have 

D £ U £ = (UD + rI)(UD + 2rl) ■ ■ • (UD + Irl) (7) 

As a consequence, if O is an element of E such that DO = 0, we have (O, D l U O) = 
r l t\ 

We have such a relation for U and D with O — and r = q 2 /(l — q 2 ) 2 ■ it's 
just equation ([6]). So the second formula of [TT] is the consequence of the following 
computation: 



V H ' n>2l 



n + t-l 
21 -I 



q 2n . 



Let us now turn to the first formula of Corollary QT] U^ e ■ ■ ■ t/ M1 is the linear 
combination of ribbon tableaux of content /i, with the sign of the tableau as coeffi- 
cient. So the left hand side of[TT]is (JJ„ t ■ ■ ■ U Vl %, U^ e • • • t/ Ml 0), which by duality is 
(%,D Vl ---D Vt U^---U^). 

Lemma 20. Let /x, v be two compositions with £ parts. Then 

(Q,D Vl --D Vt U lir --U ltl V) =wx ^2^,Du 1 ---D Ve _,U p $), 

p 

where p goes through the multiset of all compositions of length £ — 1 obtained by 
deleting a part of fi of size vg . 

Proof of the lemma: It is just an iterated use of Proposition [T7J with D UI 
and U^, for i equals fii,. . . successively. Two cases can occur : if /Xj ^ vg., 
then D Vl and U fli commute; otherwise, for each index i such that /i; — vg, a term 
f£(0, D Vl ■ ■ ■ D Vl _JJ p %) has to be added, where p is the composition with the part 
Hi deleted in /i. Then when D Vi Up i7 the scalar product is zero since D Vt $ = 0. □ 

The proof of the first part of the Corollary [TTJ is now a simple induction on £ 
based on the preceding Lemma. 
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9. Columns of the character table of 6„ 

Ribbon tableaux are known to have a strong connection with the representation 
theory of the symmetric group, which we will now recall briefly. Let n be a positive 
integer, A a partition of size n; we note \ X the irreducible character of 6 n indexed 
by A (for more information on these topics, see for instance [101 IH] that have a 
combinatorial approach). Let also \p\ be the value of this character on a permuta- 
tion of cycle type fi: this means that the permutation has m$ cycles of length i for 
each i if /j, = (l m ^2 m2 ■ ■ ■ ). The Murnaghan-Nakayama rule [TH[T7] states that: 

Theorem 21. Let be two partitions of the same size n. Then 

= \RTxJ± 

This rule gives a combinatorial interpretation of y*, and shows in particular that 
it is an integer. We will now show that Theorem 1 121 is adapted to study the column 
sums of the character table. 

9.1. A formula for YlxXu,' Define C(/i) = J2\X^ 7 the sum of all entries of 
column /j, in the character table of S„. By the Murnaghan-Nakayama rule, C(/i) 
is equal to the signed sum of all ribbon tableaux of content /i. By Theorem [T2l 
this last quantity is itself equal to the signed sum of hook involutions of content /i. 
The preceding result can thus be summed up by C(/i) = \RT^\± = \TLI\±. Using 
Corollary [9l we finally obtain 

c{ji) = \ni spec (fx)\. (8) 

This shows in particular that C(/i) is a nonnegative integer; the following theo- 
rem gives a formula for the exact value of this integer. 

Theorem 22. Let \i = (l m i2 m ' 2 • • • ) be a partition. Then C{p) = H i>0 c i%m% with: 

Ci.rm = if i is even and rrn is odd; 

= (mi — 1)!! ■ i mi / 2 if i is even and rrii is even; 

= ES J L^ 2 J-(2fc-l)!!^ fe H * is odd. 

We will exhibit two proofs: first a bijective one, and the second algebraic, using 
the tools of Section [8l 

First Proof: The computation of \HI spec (^)\ for general fj, reduces clearly to the 
case = [i mi ] where \x has only one part size. 

In this case an element of 7iZ spec (/Lt) is an involution on [l,afc] with a choice 
of a hook of size ak for each cycle of length 2. Remembering that elements of 
TLI spec {^i) have no fixed points corresponding to even parts, we obtain easily the 
above expression for the coefficient Ci iTni , and the proof is complete. □ 

Second proof: We now give a proof that does not use Theorem [12] (and thus 
also not the Equality (jHJ) ) . For this we need the following algebraic consequence of 
Proposition [T5] in terms of the operators Di and Ui (considered as endomorphisms 
of K Y ); we note Y the vector XaeY ^ *= ^ Y > an< ^ 0i ^ s 1 when i is odd and 
otherwise. 

Proposition 23. For all i > 1, we have Z3;Y = JJjY + Oj • Y. 
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Proof: Take the scalar product of each member of the equality with a partition 
A, and remembering that Ui and Di are dual operators, the result is equivalent to 

£ (/V A )= £ (Vm)+ov 

This is an immediate corollary to Proposition [15] □ 

By the Murnaghan-Nakayama rule, we have C{y) = (D^Y, 0). We will use the 
relations of Propositions [T71 and to compute this scalar product. 

Lemma 24. We have the following formulas: 

1. Form > 2 audi > 1, L>™Y = o t ■ D^Y + (m- l)i ■ D^Y + U l D^ 1 Y. 

2. For to > 1 and i > 1, D" l Y = Ci iin Y + >m Y, where Ci iTn is defined in 
Theorem ] 2SX and Ai iTn is an endomorphism o/K Y . 

3. For m > 1 and i > 1, (£>^Df Y,0) = c^ m (Z? Al Y,0) £/ a// parts o/ ,u are 
greater than i. 

Proof of the lemma: We have £>™Y = o ( • Df~ l Y + Df-^Y thanks to 
Proposition |2"51 Using m — 1 times the relation -DiC/i = UiDi +i ■ I, point 1. of the 
lemma is proved. 

By an immediate induction on 1., we can write for all to > 2 that D™Y = 
^ m Y + UiBY for a certain endomorphism B and an integer bi im necessarily equal 
to (D^Y, 0). Substituting in 1., and taking the coefficient of in each member, 
we obtain 6, j7n = Oib i m _i + (m — l)i6j m _2- The numbers Cj j7n verify the same 
recurrence relation, as can be easily seen, directly or by the combinatorial inter- 
pretation given in the first proof. Since we have in addition o; o = c^o = 1 and 
&i,i = Ci,i = Oi, it follows &i >m = Ci >m for all i, m and point 2. is proved . 

Finally, thanks to point 2., the left member of 3. is equal to 

Ci, m (D»Y, 0) + (D^UiAi^Y, 0), 

Since -D^ commutes with Ui by Equation the second term is then because 
the image of Ui has null intersection with K0, and the lemma is proved. □ 
The proof of Theorem [221 is now immediate by induction on the number of 
different part sizes of using formula 3. in the previous lemma. □ 

9.2. Other enumerations of C(fi). The formula of Theorem |2"21 is not new, but 
the proof above is (to the best of our knowledge) the first fully bijective proof of it 
based on the Murnaghan Nakayama rule. Let us mention two other places in the 
literature where this result is shown, and show the equivalence to our formulation. 

The computation of C(/t) is an exercise in Macdonald's book [XSl P-122, ex.11], 
and relies on symmetric function techniques. It is proved that C{n) is equal to 
the product Y\.%>\ a i > where a|"^ is the coefficient of t m /(m\) in exp(i + \it 2 ) 
{respectively exp(irf 2 )) if i is odd (resp. even). Through an expansion of the series, 

one checks easily that is indeed equal to the coefficient Ci_ m of Theorem [22] 

Another proof can be found in Exercise 7.69 of Stanley's book [27]; the proof is 
based on a general result in character theory, whose specialization to the symmetric 
group is the following theorem: 

Theorem 25 ([HI [27]). Let a be a permutation of [l,n] with cycle type \i. Then 
C(/i) is equal to the number of square roots of a in & n , i.e. to the number of 
permutations t S 6„ such that r 2 = a. 
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Proof: Thanks to the formula ijHJ, we can prove this result by exhibiting a 
bijection HiToRoot between HT spec (fi) and {t | t 2 = cr}. 

We consider each cycle of a as a word xo~(x)a 2 (x) . . . where x is minimal in 
its orbit, and decompose a canonically in the form [c^ ■ • ■ ][c!j • ■ ■ c 2 " 12 ' 1 ] • • ■ , 

(k) 

where c\ , k = 1 . . . , are the cycles of length i written in increasing order of 
their minimal elements. For instance, the permutation 574389216 has cycle type 
li = (3,2 3 ) and will be written [(27) (34) (69)] [(158)]. 

Lemma 26. Let c\,ci be two disjoint cycles of length m in 6 n . 

• There exist exactly m cycles c of length 2m in & n such that c 2 = c\C2- 

• If m is odd, there exist a unique cycle c of length m in & n such that c 2 = c\. 

The proof of this lemma is immediate. The m cycles of the first part of the 
Lemma will be denoted root(c\, C2, j), j — 0...m — 1, and the unique cycle of 
length j determined by the second part is root(c\). 

Let us now fix an element / 6 7iZ spec (/i); it is equivalent to a sequence of hook 
involutions Ij, j = 1 ... k where Ij is element of 7il S pec(j mj )■ Write tj (resp. fj) 
for the number of transpositions (resp. fixed points) in the involution Ij. Let us 
also write (x 3 , y s ), s = 1 . . . tj these transpositions and z t ,t — 1 . . . fj for the fixed 
points. Finally let h s S [0, j — 1] be the height of the hook associated to the 
transposition (x s ,y s ). 

We now associate to Ij the tj cycles of length 2j defined by root(cj B , Cj S , h s ),s = 

1 . . .tj, as well as the cycles of length j root(c- ),t = 1 . . . fj. The product of all 
these disjoint cycles for all indices j form a permutation, which is the desired root 
HiToRoot(I). □ 

We can also use the formula to answer the question : for a given integer k, what 
are the partitions \i such that the column sum C(p) is equal to k ? Let OV be the 
set of partitions with odd distinct parts. The answers for the first integers are: 

• C([a) = if and only if fj, has at least an even part with odd multiplicity; 

• C(jjl) = 1 if and only if /i e OV. 

• C(/i) — 2 if and only if 1 has multiplicity 2 and /i — l 2 G OT>, or 2 has 
multiplicity 2 and fj, - 2 2 e OV 

• C(/i) = 3 has no solution. 

• C(/i) = 4 if and only if 3 has multiplicity 2 and /i — 3 2 G OV, or 4 has 
multiplicity 1 and /i— 4 1 G OV, or 2 and 1 have multiplicity 2 and \i— 1 2 2 2 G 
OV. 

The number of solutions to C(/i) = is sequence A085642 in Sloanc's Online 
Encyclopedia [24]. The article pQ proves that another family of partitions is in 
bijection with OV, namely the partitions with at least one part congruent to 2 
modulo 4. 

10. Extensions 

In this last section we sketch three different directions for which the ideas of this 
work can be applied. 

10.1. Combinatorial proof that characters are class functions. Stanton and 
White [28] show combinatorially that, if c and d are 2 compositions verifying c= d , 
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then 

\RT x ,c\± = \RTx,c>\± ( 9 ) 

This expresses in fact that the value of the character x X on a permutation a 
depends only on the conjugacy class of a: it is a class function. In this Section we 
give local rules that realize Stanton and White's result, building on Fomin's version 
of jeu de taquin explained for instance in his appendix to Stanley's book [27] . We 
have the following proposition, whose proof can be easily done by using the encoding 
of partitions by infinite sequences explained in Appendix [A"l 

Proposition 27. Let A, /i, £ be three partitions, such that /i/X and^j \x are nonempty 
ribbons. Then exactly one of the two following cases occur: 

(1) either there exists v such that v /A and are ribbons of respective sizes 

W/M = \€/fA and If/H = ImAI, or 

(2) there exists J2 such that J2/X and are ribbons of respective size |/x/A| = 
\n/\\ and = |£//z|. 

Furthermore, we have the sign relations e{y/X)e(£/v) — e(/i/A)e(£//x) in the first 
case, and e(^t/A)e(^//2) = — £(/i/A)e(£//i) in the second case. 

We can now define the local rules: given A,/i,£ as in the proposition, we draw 
them on a lozenge as on the left of Figure [TTJ If the first case of the proposition 
occurs, we erase pi, and write v on the right vertex of the lozenge; otherwise we 
replace /i by J2. We also define inverse local rules by a simple vertical symmetry. 
Finally, we define the trivial local rule which consists of simply moving the partition 
fi from one side to the other. 

Now we go from the local to the global as we did in Section [7] Consider the 
grid Ft on the right of Figure [Til made of lozenges. We attach to each lozenge 
coordinates (i,j), with 1 < i < I — 1 and i < j < £ — 1 in the manner shown in the 
example. We fix a total order on lozenges, such that each lozenge has to be 
bigger than the two lozenges on its top left and bottom left, namely (i — l,j) and 
(i,j — 1) when they are defined. For the examples, we will use the following linear 
order: is greater than if i > i', or i = i' and j > j'. 
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Let us fix two compositions c, d of length £, such that c = d . We will represent 
elements of RT\ C on the left side of Pi, as chains of partitions labeling the vertices 
from bottom to top, and elements of RT\ c i on the right side in the same fashion. 

Now we want to select a subset of the lozenges so that when local rules are 
applied in the grid, we obtain indeed a correspondence between RT\ C and RT\ yC i. 
Fix cr a permutation such that a(c) = c', and mark certain lozenges of Pi, in the 
following way: for 1 < j < I, if <jj — k, then mark the lozenges — 1), i < I — k. 

For instance, consider c = (1, 3, 2, 1) and c' = (3, 1, 1, 2), and fix the permutation 
w = 3142 which indeed verifies w(c) = c'\ the corresponding marking is represented 
on the left hand side of Figure [T^] 

Now we start from a ribbon tableau represented on the left hand side, and go 
on performing local rules as in the beginning of Section [7] the rule being that we 
perform nontrivial local rules in the marked lozenges, while in the other (unmarked) 
ones we will use the trivial local rule. An example is given on Figure [T31 the 
definition of the marked lozenges in the previous paragraph is thus made so that 
the size of ribbons "match" between c and c', thanks to Proposition [23 this can 
be visualized on the right hand side of Figure [12J 

We remark that in the case when all lozenges are marked with a cross, then this 
corresponds to a generalization of Schiitzenberger's involution which is the case 
where all ribbons are of size 1. 
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10.2. Other correspondences based on the graph GR. In the correspondence 
of Theorem \W\ we considered pairs of ribbon tableaux of the same shape. As 
already noticed, these are very special paths in the ribbon graph GR: they start 
and end at 0, going up £ steps and then down I steps. The same ideas work to 
build correspondences for other kinds of paths, and we give an example that is well 
known in the standard case. 

We consider the paths in GR of length 2£, that start and end at 0, and which 
possess I steps up and I steps down (but in no imposed order). These are called 
oscillating tableaux (of shape 0) in the case where all ribbons are of size 1, and we 
will thus call these paths oscillating ribbon tableaux. 



The size of such a path is the half sum of the sizes of the 2£ edges (i.e. ribbons), 
and the sign is the product of the signs of those ribbons. The oscillating tableau 
above has size 5, sign +1 and length 6. Let us note Osc n ,i this signed set; we can 
then prove the following formula: 



This can be done in two ways, algebraic and bijective, following the steps of what 
was done in the case of pairs of ribbon tableaux of the same shape. 

The algebraic way to prove the identity is to notice that the quantity \Oscn, £\± 
can be expressed as the coefficient of q 2n in the series (0, (D + U) 0). Now this 
series is (2£ — 1)HQ^ iq 2l Y (this a consequence of Corollary 2.6 (a) of [25]); then 
the end of the proof goes as for the second equality of Corollary ITTI 

The bijective way consists in constructing a signed bijection between Osc n ^ and 
hook matchings of [1,2^] with size n: these are perfect matchings on [1,2^] such 
that to each pair {i,j} of the matching is associated a hook Huj\, such that the 
sum of the sizes of the £ hooks is n. Since there are (2£ — 1)!! perfect matchings, 
Proposition [6] shows that there are (2£ — l)!^™^^ 1 ) sucn hook perfect matchings. 

The bijective correspondence between Osc n ,i and the hook matchings is done as 
in Roby [18] . We illustrate this on an example on Figure [14] Instead of the grid 
Ge, we perform the bijection on a grid Tg illustrated on the Figure by dashed lines 



Hook matchings can be represented by labeling by the bottom and left side, and 
for each pair {i, j} of the matching, the corresponding hook is drawn in the square of 
column i from the left and row j from the top. In the example, the matching is then 
{{1, 3}, {2, 6}, {4, 5}}. Oscillating ribbon tableaux (A = 0, Ai, . . . , \2e-1, ^11 = 
are represented on the outside corners of the north east border, from top left to 
bottom right ( moreover, in each of the corresponding inside corners, one draws the 
smallest shape between \ and A,+i). 

Now a signed correspondence goes along the exact same lines as what we did in 
Section[7]for pairs of ribbon tableaux of the same shape: we fix a total order on the 
squares of Tg, and apply local rules in these squares, changing directions when we 
encounter a rule S or T. The example of Figure [14] does not present any occurrence 
of those last rules for the sake of simplicity. 







c 



c 




for £ = 3. 
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Figure 14: Correspondence for oscillating ribbon tableaux 



10.3. Layered graphs in duality. The techniques used in this article are a gen- 
eralization of Fomin's framework developed in [6l [7] ; we now present our theoretical 
setting in this paragraph. 

Consider a graph G = (V, E) with a sign function on the edges e : E — » {+1, — 1}. 
Suppose that V is the disjoint union of finite sets Vi, i £ N where Vb is a singleton 
{O}. We will say that G is layered graph (with zero). 

Let now Ui,Dj be the endomorphisms of KV defined for v £ Vk by Ui(v) = 
J2 e £ ( e ) v ' wnere e goes through all edges from v to v 1 £ Vk+i, and Dj is defined 
dually from KVk to KVjfe_j. 

Let us say that the layered graph G is self dual if there exist nonnegative integers 
on such that: 

DiUi =UiDi + en ■ Id 

n,i , t ji), : .r ' ./ 

Fomin's framework of self dual graded graphs is the the case where edges exist 
only between consecutive levels Vi and V^+i, and when the sign function is constant 
equal to 1. 

It is then possible to use the algebraic techniques of this work to study the 
enumeration of paths in such graphs. The relations above correspond to certain 
equalities of signed cardinals, as in the graph GR. If signed bijections proving these 
equalities are fixed, then we can determine global correspondences in the same way. 
But it obviously remains to see if there exists interesting examples to which this 
theory can be applied. 
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An important remark is that this generalizes only Theorem 1101 and its Corollary; 
to give an extension of Theorem 021 one needs additional local properties on the 
self dual layered graph, analogous to Proposition [53] in the case of GR. 
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Appendix A. Partitions as sequences of zeros and ones. 

In this appendix we will show how the encoding of partitions by words is well 
suited to the study of the operations on ribbons of Section 12.21 We follow van 
Leeuwen [30] for notations. Let A be a partition, and 5(A) S {0, 1} Z the sequence 
defined by the following procedure: we extend the top and left borders of a Fer- 
rers diagram to infinity, and read the lower right boundary from bottom to top, 
recording 1 for every vertical edge encountered, and for the horizontal edges. 

For instance, the partition (4, 2, 2, 1) has for coding word (• • • 1110101 1 1001000- • ■), 
cf. Figure [15j the sign "|" separates the parts of the border below and above the di- 
agonal of the diagram, and we consider that nonnegative indices of (5(A) are those on 
the right of |. Notice that the encoding sequences have the following characteristic 
properties (see [3Tj]): 

(1) they differ from (• ■ ■ 1111|0000 • ■ ■ ) (corresponding to the empty partition) 
in a finite number of positions; 

(2) the number of 0s to the left of | is equal to the number of Is to its right. 

Now, ribbons addable to A (respectively removable from A) are in bijection with 
pairs of indices (i, j) in Z where i < j such that Si(X) = 1 and Sj(X) — (resp. 
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Figure 16: Addition of a ribbon on (5(A). 



Si(X) = and Sj(X) = 1): i indicates the position of the head, and j the position 
of the tail. The partition fi obtained after addition or removal of the ribbon is the 
result of the exchange of and 1 at positions i and j. 

One may think of (5(A) as a configuration of particles on the infinite discrete line: 
the Is represent particles, and Os represent empty positions. So moving a particle 
in an empty position to its left (respectively right) corresponds to removing (resp. 
adding) a ribbon. Figure [TBI shows a ribbon Xj \x by an arrow between its tail and 
head, and the codes of A and /i are given on the right. 

One has then the following result: 

Lemma 28. Let X be a partition with associated sequence (5(A) , and i < j indices 
of (5(A) corresponding to a ribbon r addable to (or removable from) A; this just 
means that {Si(X), Sj (A)} = {0,1}. Then 

(1) the size of r is \r\ = j — i. 

(2) the height h of r is the number of I in (5(A) between the indices i and j, i.e. 
h = \{k £ Z | i < k < j and <5 fc (A) = 1}|. 

Proof: It goes simply by using the fact that the Is correspond to vertical steps on 
the boundary of A, and the 0s to horizontal ones; so j — i is equal to the number of 
cells occupied by r, and each 1 between i and j corresponds to going up from one 
row to another in the ribbon. □ 

Now the data of A,/i,^ (when fi, v ^ A) in a direct rule is equivalent to the 
data of (5(A) and integers i\ < j\, ii < ji (corresponding to fi/X and v/X), where 
Si 1 (X) — l,Sj 1 (X) — and <5j 2 (A) = l,<5j 2 (A) = 0. Every operation of Section [2~2l 
can be in fact easily explicated given this representation; we shall do it for the 
switchout operation of rule S. 

The rule S applies precisely when one of the following two cases occur: 

(1) h = h, 3i ^ h and 5 n+n ^ tl (A) = 1, or 

(2) ji = ji, h # «2 and S il+i2 - jl (A) = 

Let i be the common value of i\ and ii in the first case, and j the common 
value of 3\ and ji in the second case. Then applying rule S consists simply in 
defining A as the partition whose code is obtained from (5(A) by exchanging and 
1 at positions i, ji, j2 and j\ + ji — i in the first case, and at positions ix, i2,j and 
i\ + 12 — j in the second case. On Figure [17] the first case is illustrated: A is shown 
above with the ribbons, and the applications of rule S gives the partition below. 
(The symbols 'x' represent indifferently Is or 0s). 
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Figure 17: The rule S. 



One notices that the partition A is element of D^—iQj,, v), as was A: indeed, one 
gets the same partition by moving a particle following the long arrow (resp. the 
short arrow) in both partitions of Figure [17]. The rule is clearly an involution, and 
in fact exchanges cases 1. and 2. defined above. 

Now we will check finally that it exchanges signs, which is just a matter of 
counting particles, thanks to Lemma l28l Let a (respectively b, c) be the number of 
1 in A that are strictly between the indices i and j\ (resp. j\ and ]2, resp. j2 and 
ji + 32 — i)', these numbers are the same in A and A. As elements of the signed set 
Pjj-^/i, v), A and A have signs (—l) x and (— l) v , with x = 2a + b and y = 6 + 2c+l; 
this gives opposite signs since x and y have opposite parity. □ 

Appendix B. Proof of Theorems fTOl and [T2l 

In this Section we will give the proofs of Theorems IT01 and [T2l the signed bijec- 
tions having been defined in Section [7J The proof is directly inspired by Fomin's 
constructions [7], but some extra technicalities are needed in both proofs. 

B.l. Proof Of Theorem 1101 We will show in particular that the construction <j> 
defined algorithmically in 17.11 verifies indeed all properties stated in the theorem. 
We will demonstrate that this algorithm is in fact a consequence of Garsia and 
Milne's involution principle: therefore, we have to construct signed sets A, B and 
adequate functions. For this, a certain number of concepts have to be defined. 

We call border of the grid Gg a path from the top left vertex to the bottom right 
one, with South and East steps. We call inside of the border F the squares of Gg 
to the south west of F, and outside the rest of the squares. 

A good labeling of a border F is the labeling of each of its vertices by a partition, 
such that: 

• the vertices at the top left and bottom right are labeled by the empty 
partition 0. 

• for every horizontal edge of F, the labels A and ijl at the left and right end 
respectively form a ribbon n/X. 
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• for every vertical edge of F, the labels A and /j, at the bottom and top end 
respectively form a ribbon /z/A . 

Remember that we fixed a total order O on the squares of Gg. Let a O-border be 
a border F when the squares inside F are smaller than the squares outside. Such 
a border defines two squares in general: sq < (F) which is the largest square inside 
F, and sq > (F) the smallest one outside; sq < (F) is not defined when F consists of 
the left and bottom side of the grid, and sq > (F) is not defined when F consists of 
the top and right side of the grid. 

Let F be a border with a good labeling label: note that label induces a labeling 
by ribbons on the edges of F. Suppose that certain squares of the grid are filled 
(we will also say colored) by nonempty hooks. Such a coloring col is compatible 
with (F, label) if: 

• The squares inside F are not filled. 

• for every horizontal edge h of F labeled by r, there is exactly one square 
filled by a hook in the column above h when r is empty, and none if r is 
non empty. 

• for every vertical edge v of F labeled by r, there is exactly one square filled 
by a hook in the row right of v when r is empty, and none if r is non empty. 

Configurations. We can now introduce configurations, which are the main 
objects we will consider for the rest of the proof 

Definition 29. A configuration is a 3-tuple (F, label, col) where F is a O-border, 
wich is well labeled by label, and col is a coloring of Ge compatible with (F, label). 

Let (F, label, col) be a configuration on Gg. For each i <E {1,1} we note c, > 
the size of the hook in column i, or the size of the ribbon labeling the edge of F 
appearing in column i: by compatibility of label and col, exactly one of these two 
cases occur. Likewise, we note d i the size of the hook in row i, or the size of the 
ribbon labeling the edge of F appearing row i. The content of a configuration is then 
defined as the two compositions c, c', where c = (ci, . . . , q) and d = (d 1 , . . . , c' e ). 

Let us define the sign of a configuration (F, label, col) as the product of all 21 
ribbons labeling the edges of F (recall that the empty ribbon has sign +1). For 
instance, the steps C and E of Figure [10] show two configurations : C and E have 
both content ((2, 1,2), (2,2, 1)), and C has negative sign, whereas E has positive 
sign. 

A hook permutation (a, H) is a positive configuration: the border is the left and 
bottom side of Gi, all vertices are labeled by 0, and the coloring is just the represen- 
tation of (a, H) in the grid. The content of such a configuration is (c(H), c{H, a^ 1 )). 
A pair (P, Q) of ribbon tableaux of length I with the same shape is also a configura- 
tion: the border is the top and right side, the right side being labeled by P and the 
top side by Q; and all squares of the grid are empty. The sign of the configuration 
is e(P)e(Q), and the content is c(Q),c(Q). We will from now on identify hook 
permutations and pairs of ribbon tableaux to such configurations. 

We now notice that in the algorithm describing our correspondence, the transfor- 
mation Apply JocaLrule entails a change from one configuration to another. Indeed, 
an inspection of each local rule shows that the compatibility conditions in the def- 
inition are indeed respected by this tranformation. 
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Application of the Involution principle. A configuration (F, label, col) is of 
type A if rule T has to be applied in sq<(F), or if it is a permutation (which is 
when sq < (F) is not defined) . It is of type B if rule S has to be applied in sq > (F) , 
or if it is a pair of ribbon tableaux (which is when sg> (F ) is not defined) . 

We fix two compositions c\ and C2 of length £ and size n. Let A (respectively 
B ) be the configurations of type A (resp. B) and content (01,02). For instance, 
the configurations C and E of Figure [10] are of type B and A respectively, for the 
content ((2, 1, 2), (2, 2, 1)). 

Let us define an involution on A by applying the rule T in sq < (F) when it 
is defined, and letting the hook permutations unchanged. Likewise, we have an 
involution on B by applying the rule S in sg> (F) when it is defined, and letting the 
pairs of tableaux unchanged. Notice that these two involutions are sign reversing by 
Proposition [T3l We define also a bijection A — » B by applying direct rules sq > (F) 
on a type A configuration, until we reach a type B configuration. Since in this case 
we only apply rules of the form Di, the sign is preserved, thanks to Proposition [13] 
again. 

We now have all the functions verifying the involution principle of Garsia and 
Milne: this gives us a signed bijection between hook permutations and pairs of 
ribbon tableaux that verifies exactly the properties of Theorem llOi which completes 
the proof. □ 

B.2. Proof of Theorem 1121 We will use here the definitions used in the proof 
of Theorem (TU] and adapt them to the case of involutions. We consider a total 
order HO on HGg, the half grid made of the squares of Gg with i > j, and 
suppose that this order extends the order defined by r< (i',f) i£ i < i' 

and j < j' as seen before. This induces a partial order on the squares of Gg, given 
by :(i, j) is smaller than (i',j') if and only if (min(i, j), max(i, j)) is smaller than 
(min(i', j'),max(i' ,j')) for HO. We will still note HO this partial order. 

We consider configurations as in Definition |2T)1 .with the exception that the order 
HO is now used. A configuration (F, label, col) on Gg is called symmetric if F, label 
and col are all symmetric with respect to the diagonal i — j, and we name half- 
configuration the restriction to HGi of a symmetric configuration, note that the 
border / of a half-configuration consists of a path form the top left corner of HGi to 
any vertex of the diagonal i — j. Figure [TBI shows an example of half configuration. 

For a half configuration, applying a local rule in the square (i,j) E HGg means 
applying it in both (i,j) and (j, i) in the associated symmetric configuration, and 
restrict the result to HGg. Note that local rules in and (j,i) will give the 

same outputs since all our local rules are symmetric in and v. 

We represent ribbon tableaux by a chain of partitions on the top side of HGg, 
and hook involutions by the restriction of their matrix representation to HGg with 
labeling the vertices on the left. The content c of a symmetric configuration is 
of the form (c, c), so we define the content of the associated half configuration as c. 
The sign of a half configuration (/, label, col) is the product of all the signs labeling 
/, multiplied by the product of the signs of hooks appearing in the square [i,i). 
Note that this gives the desired sign on HI and on ribbon tableaux, so that we are 
indeed in the setting of Theorem [12] 

Let us note HA and HB the sets of half configurations with associated symmetric 
configurations in A and B respectively, with the partial order HO. We define the 
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Figure 18: A half configuration. 



involutions on HA and HB in the same fashion as for A and B, as well as the 
bijection between HA and HB. 

Now we wish to apply once again the involution principle: we have here to check 
the sign modifications, since the definition of the sign of a configuration has been 
modified. 

For the non diagonal squares with i > j, everything works as before: the 
application of a rule S or T changes the sign, whereas the other rules preserve it. 
Now there remains the application of a rule on a diagonal square sq. First we notice 
that only rules D1-D3 and 11-13 can be applied there, since they are the only rules 
with fi = v. One needs to prove that the sign of the ribbon on the left side of sq, 
times the sign of the hook in sq in the case of D2, is equal to the sign of the ribbon 
on the top side of sq. 

This is trivial for the rule Dl. For the rules D2 and D3, one has to look at 
the definition of prev and first fSection !2.2|) : first(\, eq) is of the same height as 
eq by definition, and thus of the same sign: this implies that rule D2 will indeed 
have the sign preserving property. For the rule D3, next(fi, /i/A)is a ribbon of the 
same height as /x/A, and so of the same sign, which implies here also that the rule 
preserves the sign. The involution principle can thus be applied, and this achieves 
the proof of Theorem [T2l 
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